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Section 14 



Optional stopping. Inequalities for 
martingales. 



Consider a sequence of cr-algebras (B n ) n >o such that B n C B n +i- Integer valued r.v. r G {1,2,.. .} is called 
a stopping time if {t < n} E B n . Let us denote by B T a cr-algebra of the events B such that 

{r < n} n B e B n , Vn > 1. 

If (X n ) is adapted to ($„) then random variables such as X T or Y^k=i Xk are measurable on B T . For example, 

{X T e A}= \J{r = n}n{X n eA}= \j({T<n}\{T<n-l}f){X n E A}) eB r . 

n>l n>l 

Theorem 31 (Optional stopping) Let (X n ,B n ) be a martingale and ti,t 2 < oo be stopping times such that 

E|X T2 |<oo, lim E|X„|I(n < r 2 ) = 0. (14.0.1) 

Then on the event {n < r 2 } 

E(X T2 |B ri ) =X T1 . 

Afore precisely, for any set A G B Tl , 

EX T2 l A l( Tl <t 2 )= EX Tl l A l{ n < 75). 
If(X n ,B n ) is a submartingale then equality is replaced by > . 

Remark. If stopping times t\,ti are bounded then (14.0.1) is satisfied. As the next example shows, 
without some control of the stopping times the statement is not true. 
Example. Consider an i.i.d. sequence (X n ) such that 

P(X n = ±2") = i. 

If B n — <j{Xi, . . . , X n ) then (S n ,B n ) is a martingale. Let T\ = 1 and r 2 = min{£; > 1,5^ > 0}. Clearly, 
5 T2 = 2 because if r 2 = k then 

S T2 = S k = -2 - 2 2 - . . . - 2 fe " 1 + 2 fe = 2. 

However, 

2 = E(S T2 \B 1 )^S T1 =X 1 . 
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The second condition in (14.0.1) is violated since P(r 2 = n) = 2 ™ and 

E|5„|/(n < r 2 ) = 2P(r 2 = n) + (2™ +1 - 2)P(n + 1 < r 2 ) = 2 0. 
Proof of Theorem 31. Consider a set A e B Tl . We have, 

EX T2 l A l( Tl < r 2 ) = ^ EX T2 l(A n {n = n})l(n < r 2 ) 

n>l 

( = } ^ EX n l(A n {n - n})l(n < r 2 ) = EX ri UI(n < r 2 ). 

n>l 

To prove (*) it is enough to prove that for A n = A n {ti = n} e 

EX r2 I An I(n < t 2 ) = EX n I A J(n < r 2 ). (14.0.2) 

We can write 

EX n l A J(n < t 2 ) = EX n l A J(T 2 =n)+ EX n l A l{n + 1 < r 2 ) 
= EX T2 I a J(t 2 = n) + EX„I A J(n + 1 < r 2 ) 

| since {n + 1 < r 2 } = {r 2 < n} c G ,S n , by martingale property j 

= EX T2 I A „I(t 2 = n) + EX n+1 l A J(n + 1 < r 2 ) 
{ by induction } = ^ EX r2 I An I(r 2 = fc) + EX m I An I(m < r 2 ) 

n<fc<m 

= EX T2 l A l(n < t 2 < to) + EX ro I A J(m < t 2 ). 

By (14.0.1), the last term 

|EX m I Aii I(m < t 2 )| < E|X m |I(TO < t 2 ) — > as to — > oo. 

Since 

X T2 I A?i I(n < t 2 < m) — ► X T2 I J 4„I(n < t 2 ) as to — > oo 
and E|X T2 | < oo, by dominated convergence theorem, 

EX T2 \ A \{n < t 2 < to) -» EX T2 I An I(n < r 2 ). 

This proves (14.0.2). 

□ 

Theorem 32 (Doob 's inequality) If (X n , B n ) is a submartingale then for Y n = maxi<fe<„ Xk and M > 

P(V„ > M) < ^EX n /(r„ > M) < ^EX+. (14.0.3) 

Proof. Define a stopping time 



min{fc : Xk > M,k < n} if such fc exists, 
n otherwise. 



Let r 2 = n so that n < t 2 . By Theorem 31, 

E{X n \B Tl ) = E{X T2 \B T1 ) > X T1 . 
Let us apply this to the set A = {Y n = maxi<fe<„ X n > M} which belongs to B Tl because 

A n {n < k} = ( max X; > m) e B fe . 
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On the event A, X Tl > M and, therefore, 

EX n l A = EX T2 l A > EX Tl l A > MEl A = MV(A). 
On the other hand, EX n l A < EX+ and this finishes the proof. 

□ 

As a corollary we obtain the second Kolmogorov's inequality. If (Xi) are independent and EJQ = then 
S n = X)i<j<n -^i is a martingale and is a submartingale. Therefore, 

p(^|5 fc |>M)=p(^S2>^)<^=^ E Var(X fe ). 

~ ~ ~ ~ l<fc<n 

Exercises. 

1. Show that for any random variable Y, E\YP\ = J™ pt p - l ¥(\Y\ > t)dt. 

2. Let X, Y be two non-negative random variables such that for every t > 0, P(F > t) < t^ 1 J XI(Y > t)dP. 
For any p > 1, ||/|| p = (/ l/^dF) 1 ^ and l/p+l/q = 1, show that ||F|| p < q\\X\\ p . 

3. Given a non-negative submartingale (X n , B n ), let X* := maxj< n Xj and X* := maxj>i Xj. Prove that for 
any p > 1 and l/p+ l/q = 1, ||^*|| P < 9sup„ ||X n || p . Hint: use exercise 2 and Doob's maximal inequality. 

□ 

Doob's upcrossing inequality. Let (X n ,B n ) n >i be a submartingale. Given two real numbers a < b we 
will define a sequence of stopping times (r„) when X„ is crossing a downward and b upward as in figure 14.1. 
Namely, we define 




Figure 14.1: Stopping times of level crossings. 

T\ = min{n > 1, X n < a}, t 2 = min{n > t 2 : X n > b} 
and, by induction, for k > 2 

r 2 fc-i = min{n > r 2k - 2 ,X n < a}, T 2k = min{n > 2k — l,X n >b}. 

Define 

i/(a, b, n) = max{fc : T 2k < n} 
- the number of upward crossings of [a, b] before time n. 

Theorem 33 (Doob's upcrossing inequality) We have, 

Ev(a, b, n) < E(X "~ a)+ . (14.0.4) 
o — a 

Proof. Since x — > (x — a) + is increasing convex function, Z n = (X n — a) + is also a submartingale. Clearly, 

Hx(a, b, n) = i^(0, 6 - a, n) 

which means that it is enough to prove (14.0.4) for nonnegative submartingalcs. From now on we can assume 
that < X n and we would like to show that 

Ev{Q,b,n) < 
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Let us define a sequence of r.v.s 
i.e. r]j is the indicator of the event that at time j the process is crossing [0, b] upward. Define Xq = 0. Then 



1, T 2k -i < j < T 2k for some k 
0, otherwise, 



6i/(0, b, n) < ^VjiXj - Xj-t) = J2l(Vj = l)(Xj - X^). 

3=1 3 = 1 



The event 



. , ^ — 



{Vj = 1} = \J{T2k-l <j< T 2 fe} = (J {r 2 fe-i < j { T 2k < j ~ l} G 

fc fe 

i.e. the fact that at time j we are crossing upward is determined completely by the sequence up to time j — 
Then 

n n 

bEu(0,b,n) < ^EE^I^- = l)(X 3 - X^) B^^j = ^EI(^ = l)E(Xj - X^B^x) 

3=1 3=1 

n n 

= = i)(EPOI^-i) - < E E (*> - x o-i) = EX «< 

3=1 3=1 

where in the last inequality we used that (Xj,Bj) is a submartingale, K(Xj\Bj-i) > -Xj-i, which implies 
that 

i( Vj = i){nx 3 \B 3 ^) - x^) < nx 3 \B^) - 

This finishes the proof. 

□ 
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